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CLAIMS 

1. A neural network, comprising several nodes 
forming at least two layers a first one of which is a 

5 so called input layer and the last of which layers is a 
so called output layer, the input layer nodes forming 
inputs for entering the input data of a database and 
the output layer nodes forming outputs channels for 
furnishing output data which are the results of the 

10 elaboration of the input data, connection being 
provided between the nodes of the input layer and the 
nodes of the output layer, each node of the output 
layer carrying out a transformation of the input data 
received from the input layer into output data which 

15 transformation comprises a first transformation step 
comprising at least a sub-step consisting in summing 
the input data received from the input nodes to the 
said output nodes by weighting the said input data and 
a second transformation step which transforms non 

20 linearly the results obtained by the first 
transformation step the output data obtained by the 
said transformation carried out in an output node being 
the output data 
characterised in that 

25 in each output node the first transformation step 
comprises two sub-steps a first sub-step being a non 
linear transformation function of the input data 
received by the output nodes from the input nodes and 
the second sub -step being the summing step of the said 

30 non linearly transformed input data in the said first 
sub-step. 

2 . An artificial neural network according to claim 
1 comprising an input layer having a predetermined 
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number of input nodes and an output layer having a 
predetermined number of output nodes , characterised in 
that between the input and the output layer there is 
provided at least one further layer of nodes, so called 
5 hidden layer, or more than one hidden layers, the nodes 
of this hidden layer being connected by weighted 
connection to the input nodes of the input layer and to 
the nodes of a further hidden layer when more than one 
hidden layer is provided or to the output nodes of the 

10 output layer if only one hidden layer is provided, each 
node of the at least one hidden layer or of the more 
than one hidden layers and the nodes of the output 
layer carrying out a transformation of the input data 
received from the input layer or from a preceding 

15 hidden layer into output data which transformation 
comprises a first transformation step consisting in two 
subsequent sub-steps, a first sub-step consisting in a 
non linear transformation function of the input data 
received by the output nodes or by the nodes of a 

20 hidden layer from the input nodes of the input layer or 
by the nodes of the preceding hidden layer and the 
second sub-step consisting in summing the said input 
data being non linearly transformed in the said first 
sub-step by further weighting the said non linearly 

25 transformed input data and a further second 
transformation step being carried out which transforms 
non linearly the results obtained by the first 
transformation step, the output data obtained by the 
said transformation carried out in the said nodes being 

30 the output data if the nodes are the output nodes of 
the output layer or the input data furnished from the 
nodes of a hidden layer to the nodes of a following 



-37- 



WO 2005/024718 



PCT/EP2004/051891 



hidden layer or to the output nodes of the output 
layer . 

3. An artificial neural network according to claim 
1 in which the input data of the nodes of the input 

5 layer consist in the input data of the database, while 
the output data of the nodes of the input layer are 
furnished to the nodes of the output layer or to the 
nodes of the first hidden layer or to the at least one 
hidden layer as input data of the nodes of these layers 
10 and the output data of the output layer consist in the 
elaboration result of the artificial neural network. 

4. An artificial neural network according to one 
or more of the preceding claims characterised in that 
the first non linear transformation sub-step of the 

15 input data carried out by a node comprises a 
transformation of the input data by means of a 
sinusoidal function and the second transformation sub- 
step consist in the sum of the input data after 
transformation by the sinusoidal function, i.e. after 

20 having carried out the said first transformation sub- 
step. 

5. An artificial neural network according to one 
or more of the preceding claims, characterised in that 
each node of the at least one hidden layer and of the 

25 output layer comprises several input channels for 
different input data; 

to each channel being associated 

a receiver unit for carrying out the first non 
linear transformation sub-step of the first 
30 transformation step; 

a summation unit being further provided having an 
input connected to the outputs of the receiver unit of 
each channel and for carrying out the second 
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transformation sub-step of the first transformation 
step by summing the non linearly transformed input data 
of each channel to a value 

and a non linear transformation unit having an 
5 input connected to an output of the summation unit for 
carrying out the second transformation step by non 
linear filtering of the value obtained by the first 
transformation step and furnishing the output value of 
the node which is the input value of the nodes of a 

10 following hidden or of the output layer. 

6* An artificial neural network according to one 
or more of the preceding claims , characterised in that 
input data consist in a predetermined number of 
variables in a input data variable space each variable 

15 being defined by coordinates in the input data space 
and each coordinate in the input data space is non 
linearly transformed in the first transformation step 
in a corresponding variable value which is made 
dependent by the spatial position of the coordinate 

20 value with respect a spatial wave of given wavelength, 
this dependence consisting in multiplying the input 
coordinate values, by the wavelength of a sinusoidal 
wave which are then transformed into the same value, 
the wavelength on each input coordinate being tuned 

25 during the learning phase. 



the transformation of the input data carried out by 
each node is defined by the following equation 



where the non linear transformation F(-) is the non 



7. An artificial neural network according to one 
or more of the preceding claims characterised in that 



30 




linear filtering function of the second transformation 
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step and G(-) is the combination of the non linear 
transformation function of the first trans formation 
sub-step and of the second linear transformation sub- 
step consisting in the sum of the non-mono tonically, 
sinusoidal processed weighted inputs according to the 
following function: 



M (5) 



where 



[s] 

10 : the generic layer of the network, with s=l for the 

input layer and increasing values for the hidden and 
output layers; 

x [s] 

J : the output variable of the J node in layer 

Is]. 

9 

Jcf 5_1J i-th 
15 ' : the ' input to the generic node in layer 

^ from the node in layer ; 

x [s-ll 

0 : a "false" input to the generic node in layer 

[s] 

, artificially introduced to represent, in a 
mathematically convenient way, a useful threshold value 
20 which is usually fixed to 1. 

Jl : the weight on the connection joining the 1 node 

in layer ^""^ to the J ~ th node in layer ^ ; 

n 

: the number of input to the node. 
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8. An artificial neural network according to claim 
7 , characterised in that each node carries out a 
transformation of the input data according to the 
following function: 




The sine function introducing a qualitative process as 

each weight Ji plays as a 2u / wavelength parameter in 
the i-th coordinate of the input space of the j-th node 
of the s-th layer. 
10 9- An artificial neural network according to one 

or more of the preceding claims characterised in that 
the second non linear transformation step is carried 
out by means of a sigmoid function. 

10. An artificial neural network according to one 
15 or more of the preceding claims characterised in that 
it is a multilayer Back propagation neural network 
comprising a forward phase and a learning phase which 
uses a gradient descent principle; 

the forward phase being defined by the following 
20 equations : 

A first harmonic transformation step furnishing 
the transformed net input value I where 

/W = 2££ sin (^>.xr") m 

n 1=0 

A second non linear transformation step by means 

25 of a so called activation function J determining 
the output of the node according to the equation: 
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^=/(/<»>)=/f^£sin(^'.^- 1 >)' 



(8) 



the learning phase being defined by the following 
equations : 



5 The gradient descent principle 

Ji (10) 

with usual Global Error functions, the error on each 
node is evaluated by defining the local according to 
the equation: 



dE 



di 



[s] 



10 



Thus obtaining 



Aw$ = -Icoef 



(12) 

dE 



= -Icoef 



dE *jr?_ 



J J* (13) 



= lcoef .^._^_ 



\ 



9 ^sin^-xr) 



n 



15 



and for determining the weights correction value, the 
local error J being calculated as: 
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For the output layer: 



as 



dE 



dx™ 



J 



tele*] dI [p»n 



(14) 



5 For the other layers : 



10 



JLs) _ 
e j 



dE 



dE 



dlf 

affl 



= -/'(/? ] )-£ 



j _ 

dxf dlf 

r dE 4' +1] ' 



(15) 



11. An artificial neural network according to 
claim 10, characterised in that 

the activation function of the forward phase 



is the sigmoidal fucntion: 

Jp=sigm{lf)= 



1 



15 



l+e ,J 



(9) 



the error function of the learning phase is the 
Medium Square Error function: 
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1 k=\ 



(id 



the weight correction value for the output layer 
becoming 



, di i r ,] 



f(i [ r ] ) 



the weight correction value for the other layers 
becoming 



10 



( 



-e 



a>c [s] 

J 



^£(sin(^r , ^ ) )) 



V 



J J 



12. An artificial neural network according to one 
or more of the preceding claims, characterised in that 
15 the input nodes of the input layer carry out a first 
non linear transformation step and a second non linear 
transformation step of the input data received by being 
provided with the following units: 

a receiving channel for input data 
20 a receiver unit associated to the said receiving 

channel for carrying out the first non linear 
transformation sub-step of the first transformation 
step as defined in the previous claims; 

a summation unit for carrying out the second 
25 transformation sub-step of the first transformation 
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step by summing the non linearly transformed input data 
of each channel to a value as defined in the previous 
claims ; 

and a non linear transformation unit for carrying 
5 out the second transformation step by non linear 
filtering of the value obtained by the first 
transformation step as defined by the previous step and 
furnishing the output value of the input nodes node 
which is the input value of the nodes of a following 
10 hidden or of the output layer. 



-45- 



